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THE EFFECTIVENESS OF INCORPORATING A REAL-TIME 
OCULOMETER SYSTEM IN A COMMERCIAL FLIGHT 
TRAINING PROGRAM 

By 

Dennis H. Jones 1 , Glynn D. Coates 2 and 
Raymond H. Kirby 3 

INTRODUCTION 

One frequently cited example of an information processing system in- 
volving a man-machine interface is the piloting task. Only recently, how- 
ever, have technological advances allowed researchers to gain insight into 
the information gathering processes by pilots and copilots. Since Merchant 
(1969) developed the Honeywell oculometer, an unobtrusive, wide-angle, eye 
movement recording device, researchers for NASA/Langley Research Center have 
evaluated various aspects of instrument scanning behavior by private and 
commercial pilots (e.g., Dick, 1980; Dick and Bailey, 1967; and Harris and 
Christhilf, 1980; Spady, 1978; Spady and Harris, 1981). 

Recently, investigators evaluated the effectiveness of providing in- 
formation from prior research on the training of commercial airline pilots 
and copilots (Jones, Coates and Kirby, 1981). Jones et al. , sought to 
determine if information concerning the instrument scanning behavior of 
experienced pilots benefited pilot and copilot trainees in a commercial 
flight training program. The results indicated that a training tape, devel- 
oped by NASA/LaRC, had little or no effect on instructor pilots' (IPs) 
ratings of trainees' simulator performance or trainees' self-reported eye- 
scan behavior. The IPs and trainees suggested that a program providing 
individually-oriented feedback of each trainee's scanning behavior would be 
more helpful than a general type of intervention strategy. 

1 Research Associate, Department of Psychology, 0.' d Dominion University, 
Norfolk, Virginia 23508. 

2 Professor, Department of Psychology, Old Dominion University, Norfolk, 
Virginia 23508. 

3 Professor, Department of Psychology, Old Dominion University, Norfolk, 
Virginia 23508. 
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The major purpose of the present study, therefore, was to assess the 
effectiveness of inccrpornt ing a real-time oculometer system in a commercial 
flight training program on performance, and self-reported scanning behavior, 
by pilot and copilot trainees. 

The flight training personnel had suggested previously (see Jones, et 
al., 1981) that an unusually large number of pilot and copilot trainees 
showed a performance decrement on or about the third day of simulator train- 
ing. The research by Jones et al., (1981) failed to find objective support 
for a performance decrement; however, feedback from pilot and copilot train- 
ees indicated that performance difficulties might be related to the order in 
which their simulator training occurred. Trainees received simulator train- 
ing in pairs requiring the trainees to alternate the order of training with- 
in a session. Since these data were not available in the previous study, 
the present research sought to incorporate objective means of investigating 
the "third day phenomenon," including the role of order of training on 
performance . 


METHOD 


Flight Training Program 

The flight training program attended by each trainee involved four 
weeks of training, consisting of 15 days of ground school and five days of 
737 flight simulator training. Simulator training was received by the 
trainees in pilot or copilot pairs, each pair having the same IP for all 
five simulator sessions. The daily simulator sessions lasted four hours for 
each pair of trainees. Over the five sessions, each pair of trainees alter- 
nated the order in which they would receive two hours of instruction. Al- - 
though each pair of trainees performed virtually the same flight maneuvers 
in each simulator session, the order in which they were asked to perform the 
maneuvers differed somewhat. The time of day at which each simulator ses- 
sion occurred was rotated among the pairs of trainees throughout the five 
days. The first session of each day began typically at 0800, with subse- 
quent sessions beginning every four hours after that until all trainees had 
received training. Generally, the training sessions concluded by midnight 
each day. 
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In most cases, the subjects received training on five consecutive cnys; 
however, some pilot trainees in the control and experimental groups had a 
two day break between simulator Sessions 2 and 3. 

NASA/Lang.ley Research Center Oculometer System 

The oculometer system developed by Merchant (1969) and adapted for use 
in experiments involving the piloting task by NASA engineers has been 
explained elsewhere (e.g., Harris and Christhif, 1980). The system used a 
corneal reflection technique that allowed for a cubic foot of head movement. 
As can be seen in Figure 1, an electro-optic head, through which an invisi- 
ble infrared light was emitted, was installed in the lower inside instrument 
panel. The oculometer computer processed the reflection from the cornea, 
through the electro-optic head and generated a small white dot that would 
vary in congruence with the eye movements of the trainee. 

For purposes of the present project, two systems were developed to 
provide IPs and trainees feedback concerning instrument scan behavior. The 
real-time system (RTS) combined the computer generated eye-movement indica- 
tor (i.e., the small white dot) with sophisticated video equipment to pro- 
vide the IPs with a real-time view of the scanning behavior of each trainee. 
It should be noted that only the trainee undergoing a training period (i.e., 
two hours) was tracked. No attempt was made to track instrument scanning by 
the non-flying trainee 

Figure 2 shows two video cameras installed on the ceiling of the simu- 
lator and a small video receiver in a compartment to the right of the IPs' 
console. The camera's picture of the flying trainees instrument panel was 
shown through the video receiver with the small white dot superimposed over 
it. The computer generated dot would move around the instrument panel 
picture simulating the eye-movements of the trainees as they performed the 
various flight maneuvers. The RTS allowed the IP to evaluate and suggest 
adjustments in the instrument scans of the trainees. 

The videotape feedback system (VFS) was developed to provide trainees 
with videotapes of their scanning behavior following each simulator session. 
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Each videotape was accompanied with a procedure to view specific maneuvers, 
if desired. The VFS allowed IPs to provide in-depth feedback to trainees 
about their instrument scanning, and also permitted trainees to review 
interesting or problematic maneuvers. 

Subjects 

The subjects were 58 pilot and copilot trainees attending the 737 
flight training program at Piedmont Airlines Training Center. Of the 28 
trainees in the control group, data from seven trainees were eliminated from 
the experiment for being incomplete. Of the 30 trainees in the experimental 
group, data from six trainees were eliminated since their training occurred 
during the calibration of the oculometer systems; two trainees declined to 
participate, and data from six trainees were eliminated for being incom- 
plete. Table 1 presents the relevant demographic data on the remaining 
trainees. 

Table 1. Demographic data for copilots in the control group (CC), pilots in 
control group (CP), copilots in the experimental group (XC), 
pilots in the experimental group (XP). 




Flight 

Experience 

(In Average Hours) 

Group 

N 

Small 

Aircraft 

Non- Jet 

Jet 

737 

CC 

10 

1676.0 

1150.0 

10 90. 0 

0 

CP 

11 

2500.0 

4290.9 

1164.7 

1577.6 

XC 

4 

980.0 

2337, 5 

1287.0 

0 

XP 

12 

2212.0 

1962.0 

891.7 

1660.7 


An additional group of subjects consisted of nine IPs. All IPs were 
fully qualified pilots on the Boeing 737 and had been IPs for at least one 
year. 

Instructor Rating Forms 

The instructor rating forms used in this study were a revised version 
of the forms used in the previous study (Jones, et al. , 1981). The 
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researchers met with the IPs prior to the start of the present study and 
revised the rating forms specifically for each simulator session. IPs were 
asked to rate each trainees' performance on various tasks in each simulator 
session using a magnitude estimation scale of 0-100 (D'Amato, 1970), with a 
higher score reflecting better performance. These data were used to compare 
IPs ' ratings of performance for trainees exposed to feedback of their scan- 
ning behavior to those trainees in the control group. 

The IPs for the trainees in the experimental groups were also asked to 
rate the usefulness of the RFS on a scale of 1-10., where 1 corresponded to 
"not useful at all," and 10 corresponded to "extremely useful." These data 
were used to assess the usefulness of the oculometer system for the experi- 
mental groups. 

Eye-Scar 1 Survey 

The eye scan survey was a paper and pencil task which presented five 
different manual approach situations and diagrams of an instrument panel 
(see situations 1-5, Attachment I, Jones et al. , 1981). The trainee was 
asked to draw the "typical" instrument scan pattern for each flight situa- 
tion for a 10-second period. The order of presenting the flight situations 
was random to control for order effects. These data were used to measure 
changes in self-reported eye-scan patterns for control and experimental 
groups . 

Trainee Rating Forms 

Trainees in both control and experimental groups were asked to rate, 
their performance for each simulator session using the same magnitude esti- 
mation scale (0-100) used by the IPs. These data were used to compare 
trainees' self-ratings of performance for control and experimental groups. 

Subsequent to session five, trainees in the experimental groups were 
also asked to rate the usefulness of the oculometer system on a scale of 1- 
10, where 1 corresponded to "not useful at all" and 10 corresponded to 
"extremely useful." The data were used to assess the usefulness of the 
oculometer system as perceived by trainees in the experimental groups. 
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Procedure 


Data were collected over a six month period, and involved three phases: 
(1) the control data collection phase; (2) the oculometer system calibration 
phase; and (3) the experimental data collection phase. Each phase is 
explained below. 

Control Data Collection Phase . — A researcher met with each pair of 
trainees and their IP prior to the first day of simulator training. The 
trainees were shown the instructor rating forms and the trainee daily self- 
evaluation forms, and the data collection procedure was explained. The 
trainees completed an eye-scan survey following the first simulator ses- 
sion. 

Subsequent to Session 5 of simulator training, trainees completed a 
second eye— scan survey, and were briefed as to the exact nature of the re- 
search, including (1) the goals of the research; (2) the "third-day phenome- 
non;" and (3) a request for suggestions for the use of the oculometer system 
as a training aid. 

Oculometer System Calibration Phase . — The installation of the oculo- 
meter system, video-equipment and computer hardware was largely completed 
during the control data collection phase while the simulator was not being 
used. Since all the systems including the computer software required cali- 
bration, the researchers collected data on six trainees for one week, but 
decided a prior' that these data would not be used in any analyses. 

Exper imental Data-Collection Phase . — The same procedure was used in 
collecting data with the experimental trainees as was used during the 
control data collection, with the exception that the IPs and trainees were 
briefed thoroughly concerning the RTS and VFS. 

RESULTS AND DISCUSSION 

During flight simulator training, pilot and copilot trainees must learn 
to gather various types of information from the aircraft instruments. The 
present research sought to determine whether trainees, receiving immediate 


feedback from IPs and an opportunity to view videotapes of their scanning 
behavior, would (1) perform better than trainees in the control group; (2) 
rate the oculometer as being useful in the flight training program; and (3) 
show differences in self-reported scanning behavior from trainees in the 
control group. 

Performance Ratings 

As indicated above, the IPs and trainees used a magnitude estimation 
scale to rate performance, thus the raw scores could not be used to make 
comparisons between trainees. Therefore, difference scores were computed by 
transforming r?w performance data into a matrix detailing performance rela- 
tive to Session 1. It should be noted that various transformations of the 
data were attempted, including T-scores, and Session X minus the mean of 
Sessions 1 through 5; however, the present analysis, Session X minus Session 
1, was found to best control for individual differences caused by using the 
magnitude estimation scale. Table 2 shows the average difference scores 
from IP ratings for each group in each simulator session. 

Table 2. Average difference scores from IP ratings in simulator sessions 2- 
5 (Session 1 = baseline). CC = control copilots; CP = control 
pilots; XC = experimental copilots; XP = experimental pilots. 


Sessions 


Group 

N 


2 

3 

4 

5 

CC 

10 

M< an 

5.46 

8.27 

9.74 

14.98 



S.D. 

9.12 

6.00 

12.07 

9.43 

CP 

11 

Mean 

4.44 

4.14 

5.09 

8.23 



S.D. 

3. 98 

5.15 

4.58 

5.00 

XC 

4 

Mean 

-0.44 

2. 99 

6.67 

10.11 



S.D. 

2.28 

3.18 

5.08 

5. 98 

XP 

12 

Mean 

4.88* 

9.63 

7.83 

11.43 



S.D. 

7.53 

6.05 

10.31 

9.17 


*N « 11 
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The data indicate that while each group generally showed improvement as 
they progressed through simulator training, there was no difference between 
the pilot control, copilot control and their respective experimental groups, 
given the similarity of their means and the magnitude of their variances. 

Table 3 shows the average difference scores from trainees' self-ratings 
for each group in each simulator session. The trainees' self-ratings were 
similar to the IPs' ratings in that the trainees rated themselves as improv- 
ing in each simulator session; however, the data indicate no difference 
between copilot controls, pilot controls, and their respective experimental 
groups . 

These findings are supported by data from IPs and trainees ratings for 
control and experimental groups (i.e., collapsing across pilot and copilot 
groups). As can be seen in Table 4, neither the trainees' self-ratings nor 
the IPs' ratings indicated any difference in performance by control and 
experimental groups. 

Table 3. Average difference scores from trainees self ratings in simulator 
Sessions 2-5 (Session = 1 baseline). CC = control copilot; CP = 
control pilots; XC = experimental copilots; XP = experimental 
pilots . 


Sessions 


Group 

N 


2 

3 

4 

5 

CC 

10 

Mean 

S.D. 

3.50 

12.03 

8.70 

18.29 

14.30 

16.98 

17.40 

19.38 

CP 

11 

Mean 

S.D. 

0.64 

8.91 

3.00 

8.43 

1.09 

11.45 

8.27 

21.14 

XC 

4 

Mean 

S.D. 

1.50 

4.73 

4.00 

1.16 

7.50 

2.89 

10.00 

7.07 

XP 

12 

Mean 

S.D, 

4.30* 

18.03 

7.50 

10.56 

8.17 

13.56 

14.55** 

11.72 


*N = 11 

**N = 10 
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Table 4. Average difference scores from IPs' ratings and trainees' self- 
ratings in simulator Sessions 2-5 (Session 1 e baseline). 


Rater 

Group 

N_ 


Trainees 

Control 

21 

Mean 

S.D. 

Trainees 

Experimental 

16 

Mean 

S.D. 

IPs 

Control 

21 

Mean 

S.D. 

IPs 

Experimental 

16 

Mean 

S.D. 


Sessions 

2 

3 

4 

5 

2.00 

10.34 

5.71 

13.95 

7.38 

15.52 

12.62 

20.35 

3.50* 

15.53 

6.63 

9.19 

8.00 

11.69 

13.33** 

10.64 

4.93 

6.75 

6.11 

5.80 

7.30 

9.04 

11.45 

8.03 

3.36* 

6.84 

7.97 

6.14 

7.54 

9.13 

11.06 

8.25 


*N = 14 
**N = 15 


IP Usefulness Ratings 

Subsequent to each simulator session IPs were asked to rate the 
usefulness of the oculometer system on a scale of 1-10. Table 5 presents 
the results of these ratings. 


Table 5. IPs' median usefulness ratings of the oculometer system in each of 
the simulator sessions (Scale = 1-10, where 1 corresponded to 
"system not useful and 10 corresponded to "system extremely 
useful"). XC = experimental copilots; XP = experimental pilots. 


Sessions 


Group 

N 

1 

2 

3 

4 

5 

XC 

4 

3.00 

3.50 

3.25 

4.00 

4.25 

XP 

12 

5.50* 

5.00 

5.25 

5.50 

4.50 


*N = 11 


These ratings seem to indicate that the IPs found the usefulness of the 
oculometer system to be of low to medium usefulness for both groups in each 
of the five simulator sessions. While the IPs rated the usefulness of the 
oculometer system slightly higher for pilot trainees, this may be a function 
of the higher number of pilot trainees than copilot trainees. 
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Trainees Ratings of Oculometer System 

Subsequent to Session 5, each trainee was asked to rate the usefulness 
of the oculometer system and to indicate the number of times they used the 
VFS during their flight training. Table 6 presents the results of their 
ratings and their use of the video tape feedback system. 


Table 6. Trainees' final evaluation of the usefulness of t..e oculometer 

system (Scale = 1-10, where 1 corresponded to "system not useful" 
and 10 corresponded to "system extremely useful"), and the average 
number of times the trainees used the video tape feedback system 
(VFS) during flight simulator training. 






Number of Times VFS 

Group 

N 

Mean 

Usefulness 

System was Used 

XC 

4 

Mean 

6.75 

1.75 



S.D. 

2.63 

1.50 

XP 

8 

Mean 

6.25 

2.87 



S.D. 

1. 50 

1. 93 


The data indicate that (1) the trainees rated the oculometer system as 
being moderately useful, and (2) both pilot and copilot trainees used the 
VFS approximately twice during flight simulator training. The pilot train- 
ees seemed to use the VFS more often than copilot trainees; however, once 
again, this may be a function of the larger number of pilot trainees under- 
going training while the oculometer system was installed. 

IP and Trainee Feedback 

Throughout the course of this research, various types of feedback was 
solicited from IPs and trainees in both control and experimental groups. 
During the control data collection phase the IPs and trainees were asked 
whether there were any particular maneuvers where information concerning the 
trainees instrument scanning behavior would have been helpful. The IPs' and 
trainees' comments in the control groups can be seen in Attachments I and 
II, respectively. 

During the experimental data collection phase, five types of feedback 
were solicited from the IPs and trainees. Each is described briefly below: 
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(1) Following each simulator session, IPs were asked whether they used 
the RTS to provide feedback to the trainee and, if so to please 
explain. (see Attachment III). 

(2) Following each simulator session, trainees were asked if they used 
the VFS and whether they found the information useful. (see 
Attachment IV). 

(3) Trainees who had chosen to view video tapes of their instrument 
scan behavior were asked which maneuvers they had viewed and to 
comment on VFS. (see Attachment V). 

(4) Subsequent to final simulator session, IPs and trainees were asked 
whether they had used the VFS, which maneuvers were most helped by 
the system, and to make comments about the system. (see Attach- 
ments VI and VII). 

Taken together, the IPs' and trainees' feedback indicated that the 
oculometer system may best function as a training device for trainees who 
may be having general difficulties with their instrument scanning, or spe- 
cific difficulties. For example, the IP for trainee.* 2101 and r 102 found 
that their scans were slow and that they failed to cross-check raw dsca. 
However, the IP reported that after reviewing the videotapes with the train- 
ees, their scanning behavior improved 40-50 percent. (See Attachment III, 
p. 27). The comments by the IP for tiainte 2201 (Attachment III) indicate 
how the RFS was used to provide feedback for specific performance difficul- 
ties (i.e. not incorporating the IVSI into scan). 

The comments by the trainees (see Attachment VII, p. 33) support the 
suggestion that the RFS and VFS were helpful when the trainees were encount- 
ering scan related difficulties. The comments by trainee 2204 exemplified 
the types of comments made by the trainees who utilized feedback from the 
systems . 

Eye Scan Survey 

As in the previous study (Jones, et al., 1981), the eye-scan survey was 
developed in an attempt to obtain subjective reports of the scan patterns of 
experienced pilots (IPs), pilot/copilot trainees early in training, and 
pilot/copilot trainees at the completion of simulator training. The purpose 
of the eye-scan surveys was to describe how the trainees, at these various 
stages of training, would report their scanning of the aircraft instruments. 
Because of the developmental nature of the instrument, the reader is 
cautioned to view the following results as purely descriptive. 
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To summarize the data from the eye-scan survey, th. responses of each 
trainee to the five flight situations were summarized as a transition matrix 
presenting the frequency with which the trainee shifted to instrument y at 
time, t+1 , given that he/she was viewing instrument x, at time t. The 
resulting matrices for each group were pooled to provide descriptions of 
step-wise scan behaviors for those groups. The frequency matrices were 
converted to transition probablity matrices in which the entries represent 
the conditional probabilities that tJ e trainees shifted to instrument y at 
time t+1 given that they were viewing instrument x. at time t_. 

Table 7 presents the transitional probability matrices for each group 
(following Session 1) and the IPs. The matrices present, as rows, the 
instrument indicated at time with the columns presenting the instruments 
indicated at time t+1 . For example, given that the instructors were view- 
ing the airspeed (AS) indicator at time t_, the probability that the next 
instrument indicated was the Flight Director (FD) was 0.533, while for the 
control copilots, the conditional probability was 0.863. The control pilots 
was 0.481, etc. It should be noted that the right most column presents the 
marginal probabilities associate with each of the instruments. For example, 
the IPs indicated that they spend 0.202 of the time viewing the AS indica- 
tor, while the CC trainees spend 0.155 of the time on the AS indicator 
etc . 

Judging from the marginal probabilities each group, except the control 
pilot group, spent more time on the FD and less time on each of the other 
instruments than the IPs. In all cases, however, the transitional probabil- 
ities for each group of trainees do not appear to be radically different 
from those of the IPs. 

Table 8 presents the transitional probability matrices for each group 
(following Session 5), and the IPs. As can be seen by the marginal proba- 
bilities the trainee groups continued to devote more time to the FD and less 
time to the other instruments than the IPs. 

In the previous study, Jones et al. , (1981) found that trainees shifted 
from having similar transitional probabilities to the IPs after Session 1 to 
being more dissimiliar after Session 5. The major point of divergence 
between the trainees and the IPs being an increased emphasis on the use of 
the FD by trainees. In the present study the trainees showed an higher 
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TIME 


Table 7. Transition matrix for instructor pilots (IP), control-copilots 

(CC), control-pilots (CP), experimental copilots (XC), experiment- 
al pilots (XP) , collapsed across situations and subjects. These 
data are from eye-scan survey following Session 1.* 


TIME t+1 




AS 

FD 

ALT 

ADF 

HSI 

VSI 

Marginals 


IP 

mmtmm 

0.533 

0.128 

0.000 

0.128 

0.191 

0.202 


CC 

— 

0.863 

0.061 

0.015 

0.030 

0.030 

0.155 

AS 

CP 

— 

0.481 

0.185 

0.037 

0.167 

0.130 

0.196 


XC 

— 

0.778 

0.000 

0.000 

0.111 

0.111 

0.182 


XP 

— 

0.750 

0.028 

0.000 

0.083 

0.139 

0.157 


IP 

0.412 


0.329 

0.035 

0.153 

0.071 

0.365 


CC 

0.310 

— 

0.267 

0.033 

0.214 

0.176 

0.492 

FD 

CP 

0.404 

— 

0.337 

0.022 

0.202 

0.034 

0.324 


XC 

0.391 

— 

0.217 

0.000 

0.196 

0.196 

0.465 


XP 

0.287 

— 

0.287 

0.052 

0.191 

0.183 

0.500 


IP 

0.175 

0.425 

— 

0.000 

0.100 

0.300 

0.172 


CC 

0.088 

0.789 

— 

0.000 

0.070 

0.053 

0.133 

ALT 

CP 

0.115 

0.365 

— 

0.096 

0.038 

0.385 

0.189 


XC 

0.133 

0,400 

— 

0.000 

0.067 

0.400 

0.152 


XP 

0.157 

0.533 

— 

0.000 

0.100 

0.200 

0.130 


IP 

0.000 

0.666 

0.000 

— — 

0.333 

0.000 

0.026 


CC 

0.143 

0.714 

0.000 

— 

0.143 

0.000 

0.016 

ADF 

CP 

0,:!50 

0.250 

0.000 

— 

0.500 

0.000 

0.044 


XC 

0.000 

0.000 

0.000 

— 

0.000 

0.000 

0.000 


XP 

0.000 

1.00 

0.000 

— 

0.000 

0.000 

0.017 


IP 

0.160 

0.160 

0.200 

0.120 


0.360 

0.107 


CC 

0.043 

0.848 

0.022 

0.000 

— 

0.087 

0.108 

HSI 

CP 

0.394 

0.091 

0.212 

0.030 

— 

0.273 

0.120 


XC 

0.000 

0.700 

0.300 

0.000 

— 

0.000 

0.101 


XP 

0.136 

0.818 

0.000 

0.000 

— 

0.045 

0.096 


IP 

0.100 

0.333 

0.100 

0.033 

0.433 

— 

0.129 


CC 

0.024 

0.780 

0. 146 

0.024 

0.024 

— 

0.096 

VSI 

CP 

0.086 

0.114 

0.314 

0.143 

0.343 

— 

0.127 


XC 

0.000 

0.800 

0.200 

0.000 

0.000 

— 

0.101 


XP 

0.043 

0.619 

0.087 

0.000 

0.261 

— 

0.100 


*Note : 


AS = airspeed indicator 
FD = flight director 
ALT = altimeter 

ADF = automatic director finder 
HSI = horizontal speed indicator 
VSI = vertical speed indicator 


Group Size: IP - 8 

CC - 9 

CP - 11 
XC - 4 

XP - _8 
40 
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Table 8. Transition matrix for instructor pilots (IP), control copilots 

(CC), control-pilots (CP), experimental copilots (XC), experiment- 
al pilots (XP), collapsed across situations and subjects. These 
data (except for IPs) are from eye-scan survey following Session 


TIME t+1 




AS 

FD 

ALT 

ADF 

HSI 

VSI 

Marginals 


IP 



0.553 

0.128 

0.000 

0.128 

0.191 

0.202 



CC 

— 

0.956 

0.044 

0.000 

0.000 

0.000 

0.147 


AS 

CP 

— 

0.600 

0.108 

0.046 

0.123 

0.123 

0.187 



XC 

— 

0.857 

0.000 

0.000 

0.071 

0.071 

0.122 



XP 

— 

0.718 

0.026 

0.026 

0.128 

0.103 

0.168 



IP 

0.412 


0.329 

0.035 

0.153 

0.071 

0.365 



CC 

0.322 

-- 

0.260 

0.045 

0.120 

0.252 

0.522 


FD 

CP 

0.364 

— 

0.394 

0.045 

0.129 

0 . 068 

0.382 



XC 

0.293 

— 

0.241 

0.000 

0.190 

0.276 

0.504 



XP 

0.398 

— 

0.305 

0.034 

0.127 

0.136 

0.509 



I? 

0.175 

0.425 


0.000 

0.100 

0 . 300 

0.172 



CC 

0.000 

0.952 

— 

0.000 

0.032 

0.016 

0.136 


ALT 

CP 

0.083 

0.367 

— 

0.017 

0.117 

0.417 

0.173 



XC 

0.000 

0.643 

— 

0.000 

0.000 

0.357 

0.122 



XP 

0.000 

0.727 

— 

0.000 

0.121 

0.152 

0.142 



IP 

0.000 

0.666 

0.000 


0.333 

0.000 

0.026 



CC 

0.000 

0.900 

0.000 

— 

0.000 

0.100 

0.022 


ADF 

CP 

0.167 

0.333 

0.000 

— 

0.500 

0.000 

0.035 



XC 

0.000 

0.000 

0.000 

— 

0.000 

0.000 

0.000 



XP 

0.000 

0.667 

0.000 

— 

0.000 

0.333 

0.013 



IP 

0.160 

0.160 

0.200 

0.120 

— 

0.360 

0.107 



CC 

0.000 

0.000 

0.833 

0.067 

— 

0.033 

0.065 


HSI 

CP 

0.351 

0.351 

0.297 

0.081 

— 

0.189 

0.107 



XC 

0.200 

0.700 

0.000 

0.000 

— 

0.100 

0.087 



XP 

0.150 

0.632 

0.053 

0.053 

-- 

0.158 

0.082 



IF 

0.100 

0.333 

0.100 

0.333 

0.433 

— 

0.129 



CC 

0.000 

0.922 

0.078 

0.000 

0.000 

— 

0.109 


VSI 

CP 

0.100 

0.300 

0.200 

0.000 

0.400 

— 

0.116 



XC 

0.000 

0.684 

0.263 

0.000 

0.053 

— 

0.165 



XP 

0.050 

0.600 

0.200 

0.000 

0.150 

— 

0.086 


*Note : 

AS 

= airspeed indicator 



Group Size: IP - 

8 


FD 

= flight director 




CC 

9 


ALT 

= altimeter 





CP - 

11 


ADF 

ss automatic director finder 



XC - 

4 


HSI 

= horizontal speed indicator 



XP - 

8 


VSI 

= vertical speed 

indicator 




40 
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reliance on the FD than the IPs following Session 1, with an even higher 
reliance after Session 5. However, the shift in the reliance on the FD by 
the trainees is so small it is doubtful that the differences are greater 
than what might occur by chance. Finally, there does not appear to have 
been any difference that distinguished the experimental trainees from the 
control trainees. 

Conclusions 

The performance data from the IPs and trainees indicated that the 
oculometer system did net have a uniform effect on performance by pilots and 
copilots in the experimental group. However, the reader is advised to use 
caution in evaluating the oculometer system based solely on this one study. 
It should be remembered that the measures used in this study were not objec- 
tive and, cherefore, were subject to various psychometric errors. • Futher- 
more, it may be that the measures used were not sensitive enough to detect 
differences between control and experimental groups. These qualifications 
notwithstanding, the data do provide important information about how the 
oculometer was used and the type of impact it seemed to have during flight 
simulator training. 

In contrast to the performance ratings, an evaluation of the usefulness 
ratings and feedback from the IPs and trainees suggested that the oculometer 
system was useful in ameliorating specific instrument scanning problems 
(e.g. fixating on a particular instrument; omitting an important instrument 
during a particular maneuver), It should be noted that a large number of 
trainees and IPs reported that they had benefited significantly from infor- 
mation provided by the oculometer system. 

There are at least two possible explanations for the discrepancy 
between the performance ratings and the feedback data. First, as can be 
seen in Table 1, the trainees began flight simulator training with well 
developed skills including general knowledge of information gathering 
procedures; therefore, the amount of instrument scan information needed for 
improvement was relatively small. Second, flight simulator performance was 
multidimensional with instrument scanning behavior being only one of a 
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number of dimensions used by the IPs and trainees to develop an overall 
rating of performance. For example, since "stick and rudder" skills were 
usually well developed, IPs may have emphasized knowledge of aircraft 
systems and emergency procedures more than instrument scanning behavior. 

In conclusion, these data seem to indicate that the major beneficial 
role of a real-time oculometer system in a commercial flight training pro- 
gram would be as a problem-solving or refinement system rather than a 
general instructional system. The data also suggest the possibility that 
the value of a real-time oculometer system in training enhancement is as it 
should be, inversely related to the amount of flight experience of the 
trainees . 

Third-Day Phenomenon 

As indicated above the f .ight training personnel at Piedmont Airlines 
had suggested that an unusually large number of pilot a nr: copilot trainees 
showed a performance decrement on or about the third day of simulator train- 
ing. The present research following the suggestions by pilot and copilot 
trainees collected data concerning the role of order of training with per- 
formance decrements. Furthermore, the IPs and trainees had suggested that 

performance in a particular session is generally judged relative to the 
previous session rather than session one. 

Results and Discuss ion. — Table 9 shows average IPs performance ratings 
for control and experimental groups as a function of the order of training. 
These data seem to support the suggestion that order of training within a 

session may affect performance. Specifically, the data indicate that train- 

ees who receive their training second in a simulator session show less 
improvement over performance in the previous session than if they had 
received their training first. By comparing the performance ratings of 
trainees who went first in any particular session with trainees who went 
second in that session, the trainees who went second typically showed less 
improvement in performance over the previous session than those who had 
undergone training first. It should also be noted that both control and 
experimental trainees who went second in Session 4, performed less well than 
in Session 3 (i.e., performance decrement). The data from the trainee self- 
ratings support these findings, as can be seen in Table 10. 
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Table 9. Average difference scores (Session X - Session X-l) from IPs’ | 

ratings for control and experimental groups as a function of the : 

order ol' training. 







Session/Order 


* 

Group 

Order In 
Session 1 

N 


2/2 

3/1 

4/2 

5/1 


Control 

1 

10 

Mean 

S.D. 

3.38 

5.10 

1.36 

4.01 

-0.05 

6.02 

5.23 

7.18 

| 

! 

? 

Experimental 

1 

6 

Mean 

S.D. 

2.34 

8.22 

6.63 

4.16 

-1.20 

7.16 

4.56 

3.20 

\ 






Session/Order 







2/1 

3/2_ 

4/1 

5/2 

i‘ 

Control 

2 

5 

Mean 

S.D. 

4.58 

0.90 

2.79 

2.60 

0.99 

1.94 

3.09 

1.03 

i 

Experimental 

2 

6 

Mean 

S.D. 

3.72 

7.14 

1.94 

2.95 

0 . 28 
4.13 

3.05 

3.13 

' 

Table 10. Average difference 
ees 1 self-ratings 
tion of the order 

scores (Session X - Session 
for control and experimental 
of training. 

X-l) from train- 
groups as a func- 

■■ 

1 

■ 






Session/Order 


• 

Group 

Order In 
Session 1 

N 


2/2 

3/1 

4/2 

5/1 

• 

Control 

1 

10 

Mean 

S.D. 

-0.50 

3.69 

2.80 

10.88 

-1.50 

15.09 

6.20 

22.48 

‘i 

.] 

i 

Experimental 

1 

6 

Mean 

S.D. 

0.67 

10.61 

8.00 

11.58 

-2.17 

17.15 

8.33 

12.11 







Session/Order 







2/1 

3/2 

4/1 

5/2 


Control 

5 

5 

Mean 

S.D. 

11.40 

13.22 

5.00 

6.67 

8.00 

10.34 

-2.40 

16.32 


Experimental 

6 

6 

Mean 

S.D. 

6.00 

21.73 

0.33 

14.17 

0.33 

11.43 

5.00 

10.00 
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The data from the trainees' self-ratings are directly supportive of the 
importance of order of training in performance. Once again, trainees who 
went second in a session tended to show less improvement over the previous 
session performance than trainees who went first. Futhermore the trainees 
who went second in Session 4 showed a performance decrement. 

Conclusions . — These findings are interesting and suggest that order of 
training "within a session" has significant impact of performance ratings by 
IPs and the trainees' own judgement of their performance. The results 
indicated that trainees who performed second within a session received lower 
rat I. from IPs' and self-ratings than trainees who performed first. 
Furthermore, the data revealed that trainees who performed second in the 
fourth simulator session showed a performance decrement (i.e. a rating 
lower than on the previous session), while trainees who performed first 
maintained a gradual rate of improvement. 

Within each training session, the "flying pilot" performs a variety of 
precision and emergency maneuvers. In order to perform the maneuvers 
successfully, the trainee is assisted by the "non-flying pilot" who must be 
responsive to commands by the "flying pilot." In other words, while the 
"flying pilot" is largely responsible for the state of the aircraft, he/she 
is dependent upon the responsiveness of the "non— flying pilot." Feedback 
from the trainees in this study suggest that (1) the trainees performing 
second within a session were fatigued from aving participated in the train- 
ing of the trainee who went first, and (2) the trainees who performed first 
were fatigued following their two hours of training and therefore were not 
as responsive as usual while performing the "non- flying pilot" tasks. 
Furthermore, the trainees attributed the performance decrement in session 
four to cumulative fatigue effects. 

Of course the present findings can only be substantiated with further 
research; however, it is hoped that the flight training personnel will find 
these results informative and useful. Perhaps just the knowledge that order 
within a session can affect performance will alleviate some of the mystery 
surrounding the phenomenon, and promote future inquiry by IPs and the flight 
training personnel. 
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ATTACHMENT I 


IPs' Comments on Trainee Rating Forms (Control Group) 

Q. During this simulator session, were there any particular maneuvers where 
information concerning the trainee's instrument scanning behavior would 


have 

been helpful? 

Please 

be specific. 


IP 

Trainee 

Status 



IP Data 

102 

1103 

CP 

Session 

_L " 

It would have been helpful 
i ,i almost the whole session 




Session 

_3 - 

VI Cut 

102 

1104 

CP 

Session 

JL_ - 

It would have been helpful 
in almost the whole session 




Session 

2 " 

VI Cut 

103 

1201 

P 

Session 

JL_ - 

Steep turns and Emergency 
Descerit 

105 

1204 

P 

Session 

_1_ - 

Emergency Descent 

107 

1105 

CP 

Session 

_L " 

No 

102 

1207 

P 

Session 

_2 - 

VI Cut and Steep turns 

102 

1208 

P 

Session 

_1_ - 

VI Cut, Steep turns and 
smal Is 




Session 

_2 - 

VI Cut and Steep turns 

107 

1107 

CP 

Session 

2 - 

Nearing minimums on VOR 


approach 
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ATTACHMENT II 


Trainees' Comments on Self-Rating Form (Control Group) 


Were there any maneuvers during this training session where feedback 
concerning your instrument scanning behavior would have been helped, 

IP Trainee Status Trainee Comments 


101 1101 


101 1102 


102 1103 


102 1104 


107 1105 


108 1106 


CP Session 1 - Fixating, not smooth X check 

on approaches. 

Session 5 - Scan check would be good 
during initial session. 

Toward end old ways are 
modified up to speed. 

CP Session 1 - During ADF and ILS. 

Session" - Holding, entry and turns 
in holding. 

Session 3 - Instrument approaches and 

hold - course intercept and 
turns . 

CP Session 1 - Steep turns. 

VI Cut , 

Session 2 - Instrument scanning during 
review of APP and while 
setting NAV receivers. 

Session 4 - Instrument scan on VI Cut 
or Eng fire immediately 
after take off. 

Session 5 - low Viz, CAT II APP. Scan. 

CP Session 1 - More time should be spent on 

IVSI especially during level 
off and steep turns. 

Session 2 - Again IVSI cross check even 

more important as progression. 

Session 5 - More time spent on IVSI (es- 
pecially when experience was 
on Non-IVSI Aircraft) would 
have been helpful. 

CP Session 1 - Transition from Instruments 

to visual landing. 

Session 3 - Holding; stalls. 

Session 5 - Go around procedures. 

CP Session 3 - Yes. The heavyweight take off 

with VI cut on Rwy 23 at Roanoke 
where a turn is required im- 
mediately after. I needed to 
concentrate more closely on the 


ATTACHMENT II (continued) 


IP Trainee Status 


Trainee Comments 


ADI for proper pitch and bank 
control in starting that turn. 

107 1107 CP Session 2 - Transition from instruments 

to visual on Precision 
approaches . 

Session 5 - NDB Approach. Scan seemed 
to break down at the ADF 
instrument. 

108 1108 CP Session 1 - Yes. Trouble with the ILS 

using the flight director. 

Session 3 - Yes, during all maneuvers. 

I have been acting as a 
flight engineer for the 
last year and my scan is 
low. 

Session 4 - All instrument approaches 
Scan is improving slowly 
but I do feel that if it 
could be monitored it would 
improve faster. 

Session 5 - Today was the check ride and 
it went well but I feel that 
one more day is needed to be 
fully up to speed. Some type 
of scanning procedure might 
have helped eliminate the 
feeling that another day was 
needed 

106 1109 CP Session 1 - Steep turns; stalls. 

Session 2 - Steep turns; stalls. 

Session 3 - Steep turns. 

Session 4 - Stall #3; circling approaches. 

104 1110 CP Session 1 - Rapid depressurization; 

emergency descent; stalls; 
steep turns; ILS short final. 
For first session, not always 
sure where to initially check. 

Session 2 - NDB approach, normal ILS; 

stalls. Concentration on 
finding power settings led to 
more airspeed deviations 
resulting in higher power 
charges than necessary 

Session 3 - Circling approaches (single 

or two engine); emergency pat- 
terns (jammed stabilizer and 
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ATTACHMENT II (continued) 


IP Trainee Status 


Trainee Comments 


single engine). Cross check 
becomes considerably slower 
if compounded with emergency 
patterns. 


Session 4 - 


103 

1201 

P 

Session 1 

104 

1202 

P 

Session 1 

104 

1203 

P 

. Session 1 




Session 2 
Session 3 
Session 4 
Session 5 

106 

1205 

P 

Session 2 
Session 3 

106 

1206 

P 

Session 2 
Session 4 

102 

1207 

P 

Session 1 




Session 2 


Session 3 - 
Session 4 - 

Session 5 - 

102 1208 P Session 1 - 


Manual reversion; small #3; 
circling approaches. 

I found myself fixing on 
F.D. I finally forced 
myself on scanning pattern. 

Power adjustments. 

Yes. Setting up radios 
and fly aircraft at same 
time. VI cuts. 

Aborted T.O. 

Aborted T.O. 

ADF approaches . 

Emergency descent. 

Circle approach. 

Circle approach., 

Stalls . 

APP ILLS and VOR. 

VI cut tendency. Tc 
monitor ADI too much. 

Needed to monitor VS I more. 

VI cut - stall series. 

Scan is increasing but 
need to monitor the VSI 
more closely - also need to 
get better feel of power 
levers to the settings. 

No flap landing. Found 
self concentrating on one 
instrument to much. 

VI cut as usual - over- 
rotated - must use VIS better. 
Scan today was slower than 
yesterday. 

VOR, ARC, EME - didn't orient 
self properly. Scanned better. 

On all maneuvers, not paying 
enough attention on the IVSI 
and too much on the ADI. * 
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ATTACHMENT II (concluded) 


IP Trainee Status 


Trainee Comments 


Session 2 - All. Seems to be over 





Session 

controlling: not enough 

scanning. 

3 _ - Too much attention on 

altitude hold and flight 
director. Not watching IVSI. 




Session 

Session 

4 - Bad night. Scan very slow. 
3 " - Still slow on the scan. 

107 

1209 

P 

Session 

1 - No. I was too busy with 
trying to get the feel of 
the simulator to concentrate 
on a good instrument scan. 

103 

1211 

P 

Session 

Session 

1 - Steep turns; ILS approaches; 

VOR approach. 

_3_ - VI Cut. 
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ATTACHMENT III 


IPs' Comments on Trainee Rating Forms (Experimental Group) 


Q. Did you use the oculometer system to provide feedback to the trainee? 
yes no. Please explain. 


IP 

Trainee 

Status 

IPs' Comments 

102 

2101 

CP 

Session 1 - I believe this will be 


valuable at a later date. 

Session 2 - Pointed out that scan slow 
Did not use raw data enough. 

Session 3 - Need another day of training. 

Ses3ion~4 - After viewing tape trainee's 
scan improved approximately 
40% over previous period. 

. Session 5 - The system has been helpful 

for all five periods. 

102 2102 CP Session 1 - System INOP 

Session 2 - Pointed out that he need to 
cross check raw data more. 

Session 3 - Trainee improved approxi- 
mately 50% after viewing 
tapes of previous day. 

Session 4 - It was helpful. 

Session 5 - Trainee made a 50% improve- 
ment after viewing tape 
after second session. 

109 2201 P Session 1 - Helped to smooth out his 

flying. Caused to incor- 
porate IVSI into scan, so as 
to make smaller pitch cor- 
rections to correct altitude 
losses or gains. 

Session 2 - Stabilize sink rate of 1,000' 
per minute on non-precision. 

Session 3 - Improve altitude and air- 
speed hold during a circling 
approach. 

Session 5 - Used it for steep turns and 

go arounds with an engine out . 
In the engine out, told 
student to scan IVSI to 
maintain a positive rate of 
cl imb. 

109 2202 P Session 1 - Helped to incorporate the 

IVSI more into his flow. 

Helped to smooth out pitch 
charges on aircraft. 
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ATTACHMENT III (continued) 


IP Trainee Status 


IPs' Comments 


109 2202 


107 2203 


110 


111 2206 


111 2207 


P 


P 


P 


P 


P 


Session 2 - Scan to stabilize on 1,000' 
per minute rate of descent 
on a non-precision approach. 

Session 3 - Used it less than prior 
two sessions, because we 
incorporated a better flow 
pattern due to the oculo- 
meter, for the third ses- 
sion. 

Session 1 - Student has no problem that 
could be attributed to poor 
scan. Can see potential 
especially with problem 
student . 

Session 2 - Traditional training methods 
prevailed. Did notice an 

illwicooc i.u o (.an pauLCLUi 

Session 3 - Did not seem pertinent this 
session. 

Session 4 - Scan was very complete. 

Very good session. 

Session 5 - Student had no problems that 
could be attributed to scan. 


Session 1 - On steep turns there was a 
tendency for the trainee to 
concentrate too much on 
helping instead of alt., 
airspeed and altitude. 

Session 2 - Found monitor to be help- 
ful as it showed the stu- 
dent was spending too much 
time during approach looking 
at approach plate and letting 
altitude and airspeed go. 

Session 5 - Extremely busy preparing 
student for checkride and 
90% of session was devoted 
to procedures. 


Session 2 - Very impressed. 
Session 3 - Very helpful. 
Session 5 - Very helpful. 


Session 2 - Very impressed. 
Session 3 - Helpful. 

Session 5 - Very helpful. 
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ATTACHMENT III (concluded) 


IP 

Trainee 

Status 

IPs’ 

Comments 

112 

2208 

P 

Session 1 - Able 

to discuss scan pat- 

A r • • 


terns and discuss fixation 
on one particular instru- 
ment. 


113 

2209 

P 

Session 

1 - Adjusted scan for 
and steep turns. 

stalls 

114 

2210 

P 

Session 

1 - Adjusted scan for 
and steep turns 

stalls 

115 

2211 

P 

Session 

1 - Too much attention on I VS I 


on stalls and steep turns. 
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ATTACHMENT IV 


Trainees' Comments on Self-Rating Forms (Experimental Group) 


Q. If you were exposed to video tapes of your instrument scanning, did you 
find the information useful? Please explain. 


IP 

Trainee 

Status 


Trainee Comments 

102 

2101 

CP 

Session 

2 - Helped show that I am not 
looking at the IVSI. 

102 

2012 

CP 

Session 

5 - Excellent training aid. 

107 

2203 

P 

Session 

5 - Hard to analyze video 
replay . 

111 

2206 

P 

Session 

1 - Reinforced training 
procedures. 

111 

2207 

P 

Session 

1 - I viewed a portion of 

uuc L a jj'd uJL luc Clucl l l aJiucc 

and found it very interesting 

116 

2212 

P 

Session 

5-1 have not reviewed my video- 


tapes at this time although 
I intend to do so in the next 
future. Good program! It 
proves to be very helpful at 
t imes . 


r 
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ATTACHMENT V 


Trainees' Comments on Video Tape Usage Forms 
(Experimental Group Only) 




Training 



Trainee 

Status 

Session 

Maneuvers Watched 

Comments 

2101 

CP 

2 

Steep turns; stalls; 

Help showed where I was 
not watching the IVSI. 



4 

Steep turns; stalls; 
manual reversion; 
single eng a system. 


2102 

CP 

1 

Steep turns; stalls; 

Very helfpul informa- 




ILS missed. 

tion. Excellent 
information 

2201 

P 

1 

Steep turns; stalls; 
single engine ap- 
proach. 

— — — — 



2 

Steep turns; NDB 
missed. 




3 

Steep turns; stalls; 
single engine VOR 




4 

Zero flap missed. 

I feel that his 
program has been worth 
at least one day's 
training. 

2202 

P 

1 

VI Cuts 

— 



2 

Steep turns; stalls; 
single engine ap- 
proaches 




3 

NDB miss, VOR miss; 
VI Cuts 




4 

Steep turns 

— 

2203 

P 

2 

NDB approach; split 

Very difficult to fol- 




flap landing. 

low what flight maneu- 
vers are being performe* 





and how to follow the 





eye scan to improve 
problem areas. 

2206 

P 

1 

VI cut; SE approach; 
stalls . 

— 

2210 

P 

1 

Steep turns; stalls; 

On ray steep turns it 




VI cut; CAT II APP 

indicated that I was 
almost ignoring the 
IVSI. 
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IP's Comments Usi 


VI 


lg the Final Evaluation Form 
lent a 1 Group Only) 


Maneuvers Most 
Helped by 
Oculometer System 

Comments 

— 

It seems to be very 
helpful for first 
officer training 

Stalls and 
approaches 

— 

Stalls 

Although I did not 
uce the oculometer very 
much I feel it can be 
very useful in certain 

a i fitflf- i nn a . 

Steep turns; 
stalls, non- 
precision 
approaches, and 
VI cut 

I need to review the 
scans with the students 
during the video replay 
next time to give you 
an answer. Off hand I 
don't believe the 
videos would be very 
helpful . 

Instrument 

Approaches 

I feel the oculometer 
will be very helpful 
with the problem stu- 
dent (i.e. engineer 
that hasn't flown 
lately or a student 
with low instrument 
time). This student 
already has developed 
a good pattern and 
habits and did not need 
any coaching in basic. 

All Aspects 

I think this could be 
very helpful in our 
program. Very helpful! 
With Experience. 
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ATTACHMENT VII 



Trainees 

' Comments Using Final Evaluation Form j 

: 

(Experimental Group Only) j 

| 

Trainee 

No of Times 
Video Tapes 
were Viewed 

Maneuvers Most 
Helped by 
Oculometer System 

I 

1 

1 

l 

Comment s ! 

2101 

3 

Most instrument 
maneuvers. 

i 

Very helpful. 

2102 

3 

All instrument 
work. 

— 

2201 

5 

Steep turns ILS 
missed approaches. 

As I stated earlier, I feel 
the oculometer project helped 
by no less than one days 
training. 

2202 

4 

Very helpful in 
improving scan. 

I believe this videotape 
program is very helpful. I 
feel it has improved ray 
scan 100%. 

2203 

1 

During emergencies 
when fvv is being 
distryeced from 
flying. 

To benefit from the tapes - one 
needs to have someone to 
inst" 'ct them for a session 
on th. tapes. 

2205 

0 

Vl-cuts; ADF ap- 
proaches. 

— — — 

2206 

1 

Basic instrument 
manuevers 

A good program. I wish that I 
had more time to view the 
tapes . 

2207 

1 

Any precision 
approaches or any 
instrument work 

I spent my time preparing for 
the evaluation and really 
didn't have time to view my 
tapes. 

2208 

0 

Steep turns 


Comments 

by trainee 2204: After completing 

feel that I can 
oculometer progr 
five days. 

the Captain upgrade course, I 
now objectively comment on the 
am that I participated in for 
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When I viewed the Lst session tape, I immediately 
noticed that ray scan was very limited. The tape 
also helped me to realize that I was spending 
little, if no time on engine instrument scan, 
i.e., fuel flow, oil pressure, N + N£ . This was 
very evident on takeoff rolls and right at engine 
VI speed. 

In my opinion the oculometer program helped me 
more than anyother device in improving my scan 
pattern. 

As a flight instructor, it is ray opinion that a 
system like this would be very helpful in student 
training, pilot upgrading and recurrent work. As 
I viewed each session I was able to strengthen my 
scan pattern by constanly viewing instruments 
that I knew I was spending little or no time on 
at all. 

I highly recommend the use of this excellent 
tool. 
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